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Abstract 

Let L(t) be a Levy flights process with a stability index a € (0,2), and U be an external multi- 
well potential. A jump-diffusion Z satisfying a stochastic differential equation dZ(t) — —U'(Z(t—))dt + 
a(t)dL(t) describes an evolution of a Levy particle of an 'instant temperature' a(t) in an external force 
field. The temperature is supposed to decrease polynomially fast, i.e. a(t) w t~ e for some 9 > 0. We 
discover two different cooling regimes. If 9 < 1/a (slow cooling), the jump diffusion Z(t) has a non-trivial 
limiting distribution as t — > oo, which is concentrated at the potential's local minima. If 9 > 1/a (fast 
cooling) the Levy particle gets trapped in one of the potential wells. 

PACs numbers: 05.40.Fb, 02.50.Ey, 02.50.Fz, 02.50.Ga 



1 Introduction 

In this paper we study a Levy flights dynamics in an external multi-well potential in the annealed regime. 
We are motivated by the problem of random search of the global minimum of an unknown function U with 
help of simulated annealing. For simplicity, we consider a one-dimensional case. Let U be a multi-well 
potential satisfying some regularity conditions. Classical continuous time simulated annealing consists in an 
examination of a time non-homogeneous Smoluchowski diffusion 

dZ(t) = -U'(Z(t))dt + a(t)dW(t) (1.1) 

with a temperature er(i) — > as t — > +oo. For small values of <r(t), the process Z spends most of the 
time in small neighbourhoods of the potential's local minima and makes occasional transitions between the 
adjacent wells. It is possible to choose an appropriate cooling schedule &(t), such that the diffusion settles 
down near the global maximum of U . Indeed, one should take & 2 {t) « i n (A+t) > ^ ne parameter > being a 

cooling rate and A > 1 paramcterising the initial temperature. Then there is a critical value 9 > 0, such that 
Z(t) converges in probability to the global minimum of U if 9 > 9, and the convergence fails if < 9 < 9. 
Moreover, the critical value 9 is a logarithmic growth rate of the principal non-zero eigenvalue A 1 (cr) of the 
generator of the time-homogeneous diffusion 

dX(t) = -U'(X(t))dt + adW(t), (1.2) 

i.e. |A (c)| oc cxp(— 9/a 2 ). Heuristic justification for the convergence is as follows. The principal non-zero 
eigenvalue A 1 (cr) determines the convergence rate of A to its invariant measure ii, a {dx) = c a e~xp(—2U(x)/cr 2 )dx, 
c a being a normalising factor. Thus, for any continuous positive function / we have an estimate 

|E x /(A(t)) - / f(x) fJ , a (dx)\ < Ce-^^K (1.3) 
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The weak limit of the invariant measures pL a (dy) as a — > is a Dirac mass at the potential's global minimum. 
For small values of cr(t), the dynamics of Z reminds of a dynamics of X. Thus Z(t) has enough time to 
settle down in the deepest potential well if a(t) is such that 

t\X 1 (a(t))\ -»• oo — > oo 6>§, t^+oo. (1.4) 

v v JJl {\ + t.y/ s v ; 

The logarithmic decrease rate of a was obtained in the seminal paper |GG84] . Further mathematical results 
on classical continuous time simulated an nealing can be found in |CHS87( lHS90l IHS92j IHS88) IHKS89j . We 
also refer the reader to the review paper |Gid95| and further references therein. 

Our research is motivated by the paper |SH87j by Szu and Hartley, where they introduced the so-called 
fast simulated annealing which allows to perform a non-local search of the deepest well. Fast simulated 
annealing process in the sense of |SH87| is a discrete time Markov chain, where the states are obtained from 
the Euler approximation of (|1.1|1 driven not by Gaussian noise but Cauchy noise. The new state is accepted 
according to the Metropolis algorithm (sec [MRRT53J) with Boltzmann acceptance probability which equals 
1, if the potential value in this state is smaller, i.e. the new position is 'lower' in the potential landscape. If 
the new position is 'higher', it is accepted with the probability ~ cxp(— AU/a), where AU is the difference 
of the potential values in the new and the old states, and a is a decreasing 'temperature' parameter. The 
advantage of this method consists in faster transitions between the potential wells due to the heavy tails 
of Cauchy distribution. Moreover, the authors claim that the optimal cooling rate is algebraic, a(t) w t _1 , 
which also accelerates convergence. 

In this paper, we consider a continuous-time Levy flights counterpart of the diffusion (jl.ip . Our goal is 
to study the asymptotic properties of the system in dependence of a cooling schedule. We notify the reader, 
that in regimes where a Levy flights process converges to some limiting distribution, it does not locate the 
global minimum of U, but reveals the spatial structure of the potential. 

This paper contains a heuristic derivation of results, which are proved rigorously in |Pav06j . It can be 
seen as a sequel of |IP06 a, IP06bl IIP06cj where a small-noise dynamics of Levy flights in external potentials 
were studied. We emphasise that our methods are purely probabilistic. 



2 Object of study and results 
2.1 Levy flights 

Let L = (L(t))t>o be a Levy flights (LF) process of index a G (0,2), i.e. a non-Gaussian stable symmetric 
Levy process with marginals having the Fourier transform 

Ee*^ = e-^^l", c(a) = 2 J™ dy = 2| cos(^)r(-a)|. (2.1) 

In our analysis we shall use the Levy-Khinchin representation of the characteristic function of L(t), namely 

Ee-^) = exp It f [e^ - 1 - iwyl{\y\ < 1}] -^4 , (2.2) 

[ jk\{o} \y\ j 

where denotes the indicator function of a set A. The most important ingredient of the representation 
(|2.2[) is the so called Levy (jump) measure of the random process L given by 

= [ fi + , A is a, Borel set in M. (2.3) 

Ja\{o] \y\ 

Note, that some authors prefer another parametrisation of LFs with the Fourier transform exp(— £|tj| Q ). In 
this paper we use the representation (|2.1[) due to a simpler form of the Levy measure. 

The measure v controls the intensity and sizes of the jumps of the Levy flights process. Let AL(t) = 
L{t) — Lit—) be the random jump size of L at a time instance t, t > 0, and the number of jumps belonging 
to the set A on the time interval (0, t] be denoted by N(t,A), i.e. 

Nit, A) = #{s : (s, AL S ) e (0, t] x A}. (2.4) 
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Then the random variable N(t, A) has a Poisson distribution with mean tv(A) (which can possibly be 
infinite). Note, that for any stability index a G (0,2), the Levy measure of any neighbourhood of is 
infinite, hence LFs make infinitely many very small jumps on any time interval. The tails of the density 
\y\~ 1 ~ a dy determine big jumps of LFs. Thus, E\L(t)\ s < oo, t > 0, iff J\ y \ >1 \y\ s v{dy) < oo iff 6 < a. 

2.2 External potential 

We assume that the external potential U is smooth and has n local minima rm and n — 1 local maxima Sj 
enumerated in the increasing order, i.e. 

— oo = s < m i < s i < ■ ■ ■ < s n-i < m n < s n = +oo. (2.5) 

We assume also that local extrema are non-degenerate, i.e. U"(rrii) > and U"(si) < 0, and the potential 
increases fast at infinity, i.e. |J7'(x)| > \x\ 1+c , \x\ — > oo for some c > 0. 
Under the assumptions on U, the deterministic dynamical system 

X°(t)=x- [ U'{Xl{u))du (2.6) 
Jo 

has n domains of attraction Oj = (sj_i, Sj) with asymptotically stable attractors mi. We note that if x £ Oj 
then X®(t) <S fli for all t > 0, i.e. the deterministic trajectory cannot pass between different domains of 
attraction. Denote Bi = {x : |mj — x\ < A} a A-neighbourhood of the attractor m,. We suppose that A is 
small enough, so that Bi C Oj, 1 < i < n. Due to the rapid increase of U' at infinity, the return of X®(t) 
from ±oo to B\ or B n occurs in finite time. 



2.3 Small constant temperature 



First, we consider Levy flights L in the potential U in the regime of small constant temperature. The 
resulting random dynamics is described by the stochastic differential equation 



X%{t) =x- J*U'{X^{u~))du + eL(t), iGl, t>0. 



(2.7) 



The properties of X s are studied in our previous paper |IP06bj in the case of a double-well potential. The 
general multi-well case is studied in |IP06cj . Below we formulate the results. 

For any A > sufficiently small, in the limit e — > 0, the process X s spends an overwhelming proportion 
of time in the set U" =1 -R; making occasional abrupt jumps between different neighbourhoods Bi. Thus, the 
knowledge of the transition times and probabilities is essential for understanding the asymptotic properties 
of X e . Let T*(e) = inf{i > : X^(t) G ,.,11, \. For x G Bi, the stopping time T*(e) denotes the first 
transition time to a A-neighbourhood of a minimum of a different well. Then we have the following result. 

Theorem 2.1 (constant temperature, transitions) For x G Bi, 1 < i < n, the following estimates hold 
in the limit s — > 0: 



X%T\e)) G 
ii 



e a ~E x T l (e) 



expfe), 
1 

ft' 



whe 



-l - m t 



i ^ 3, 



\Si-l 



(2.8) 

(2.9) 
(2.10) 

(2.11) 
(2.12) 



and 



denotes convergence in distribution. 
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As we see, the transition times between the wells of X e are asymptotically exponentially distributed in 
the limit of small noise, and hence unpredictable, due to the memoryless property of the exponential law. 
The transition probabilities between the wells arc noise independent and strictly positive. Thus, X e reminds 
of a Markov process on a finite state space. Indeed, the following theorem holds. 

Theorem 2.2 (constant temperature, metastability) If x G Q;, 1 < i < n, then for t > 

X°(jA^Y mi (t), e ->0, (2.13) 

in the sense of finite- dimensional distributions, where Y = (Y y (t)) t >o is a Markov process on a state space 
{mi, . . . ,m„} with the infinitesimal generator Q = (qry)£. =1> qtj being defined in (|2.1ip . qa = —Qi- 

Since none of the entries qij vanishes, the limiting Markov process Y has a unique invariant distribution 
7r = (tti, . . . , ir n ) T , which can be calculated from the matrix equation Q T ir = 0. 



2.4 Decreasing temperature 

In the annealed regime, the dynamics of Levy flights is characterised by the time non-homogeneous equation 

Zs,M = z -Jt U '( Z U u -)) du + Js-0$*> zeR,0<s<t, (2.14) 

where a positive parameter 9 denotes the cooling rate, and A > determines the initial temperature, which 
equals to (A + s)~ e . 

It is easily seen from (|2.14p , that the evolution of the process starting at time s > is the same as that 
of the process starting at time zero with a different initial temperature, namely 

(^,(* + t)) t >o = (^'(t))*>o. (2-15) 

and thus the particular values of s or A do not influence asymptotic properties of the process in the limit 
t — > oo. However, since our theory will work for low temperatures, it is often convenient to study the 
dynamics not for large values of s and t but for large values of A. 

The goal of this paper is to study the limiting behaviour of Zq z (t) as t — > oo in dependence of the cooling 
rate 9, 'initial temperature' A and initial point z. 

Similarly to the classical Gaussian case discussed in the introduction, the candidate for the limiting law 
of Zq z (t) is the invariant distribution it of the Markov chain Y from Theorem 12. 21 Furthermore, we have to 
distinguish between two different cooling regimes. 

As in the previous section, for 1 < i < n, consider the stopping times 



t. 



.A 



if{u > s : Zg Z (u) £ UjjtiBj}. (2.16) 



If z G Bi then rj'^ denotes the transition time from a A-ncighbourhood of mi to a A-ncighbourhood of 
some other potential's minimum. For all j ^ i we also consider the corresponding transition probabilities 
T > s . z (Z x (t 1 ' X ) eBj). Then the following analogue of Theorem O holds. 

Theorem 2.3 (slow cooling, transitions) Let 9 < 1/a. For z G Bi, 1 < i < n, the following estimates 
hold in the limit of small initial temperature, i.e. when A — > +oo: 

P , z (Z\t^) g Bj) - ^, (2.17) 

qi 

^^"V (2 - 18) 

qi and qij being defined in (|2.11D . 

Theorem 2.4 (slow cooling, convergence) Let 9 < 1/a. Then for any A > 0, z £ 1, the law of Zq z (t) 
converges weakly to the measure it, i.e. for any continuous and bounded function f we have 

n 

E ,zf(Z\t)) -> J2 /K>^ t - oo- ( 2 - 19 ) 
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If the cooling rate 9 is above the threshold 1/a, the solution Z x gets trapped in one of the wells and thus 
the convergence fails. Consider the first exit time from the z-th well 

<r*£ = inf{* > : Z*, £ O*}- (2.20) 

Then the following trapping result holds. 

Theorem 2.5 (fast cooling, trapping) Let 9 > 1/a. For z € Bi, 1 < i < n, 

Po, 2 (^ A < oo) = O (jir) , A^co. (2.21) 

Consequently, Eo iZ <7 i,A = oo. 

In the subsequent section we sketch the proof of Theorems 12 . 3112 .51 and discuss the results. 

3 Predominant behaviour of the annealed process 

Our study of the random process Z x is based on probabilistic analysis of its sample paths. We use the 
decomposition of the process L into small- and big-jump parts similar to that used in |IP06bj . Thus we refer 
the reader to that paper for details, and sketch the idea briefly. 

3.1 Big and small jumps of a Levy flights process 

With help of the Levy-Khinchin formula (|2.2|) , we decompose the process L into a sum of two independent 
Levy processes with relatively small and big jumps. For any cooling rate 9 > 0, we introduce two new Levy 
measures by setting 

is^(A) = v(AC\{x: \x\ < A e / 2 }), (3.1) 
v x (A) = v (A n {x : \x\ > X 6 ' 2 }) , (3.2) 

and two Levy processes £ A and r] X with the corresponding Fourier transforms: 

Ee**? =exp{tf mo} [e^y-l-iojyI{\y\<l}]^(dy)}, (3.3) 

Ee^ A = cxp {tJ mo} [e^v - 1 - iuyl{\y\ < 1}] v x (dy)} . (3.4) 

It is clear that, the processes £ A and ?y A are independent and L = £ A + i] X . 

Since v^(M.) = oo, the process £ A makes infinitely many jumps on each time interval. Its jumps are, 
however, bounded by the threshold A 61 / 2 , i.e. |A£ A | < \ 9 / 2 . Thus £ A has a finite variance, and more generally 
moments of all orders. 

On the contrary, the Levy measure of the process ?y A is finite, and its mass equals 

B */fRl f A8/2 dV + T dy -2T dy -V^ 2 (^) 

^-^-J-oo W^ + J^¥^~ 2 J^y^-* X ■ (3 - 5) 

Hence, r/ A is a compound Poisson process with jumps of absolute value larger than A S//2 . Let and W£, 
k > 0, be the jump arrival times and jump sizes of i] X under the convention Tq = Wq = 0. Then the 
inter- arrival times = t£ — t^_ ± , k > 1, arc independent and exponentially distributed with mean Z?^ 1 . 
The jump sizes W£ are also independent random variables with the probability distribution function given 

by 

p (^ A < « = v \, m [ = it / H\y\> * 9/ >*(dy). (3.6) 



^ A (K) (3 



Finally, we can represent the random perturbation in (|2.14[) as a sum of two processes, namely, 

•x 

k_ 

■T. 



dL{u) f d& f> Wl 
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3.2 Predominant behaviour 



Consider now the process Zq z given by equation (|2.14p . On the inter-arrival intervals \t^_ 1 ,t^), k > 1, it 
is driven only by the process (p x = f Q (X + u)~ e d£ x , and at the time instants it makes jumps of the size 
Wfc/(A + t^) 6 . Recall that the jumps of £ A are bounded by A e / 2 , hence the jumps sizes of tp x tend to zero 
as A — > oo for all t > 0, i.e. 

lA^I < < ^- (3.8) 

The variance of <p x tends to zero in the limit of large A, and the random trajectory Zq z (t) can be seen as a 
small random perturbation of the deterministic trajectory X z (t) of the underlying dynamical system on the 
intervals [t£_i,t£). Consider a well £li with a minimum vtii. Let initial points z be away from the unstable 
points Si— i and s,, namely z g (s^_i + A -7 , Si — A -7 ) for some positive 7. Then the deterministic trajectory 
X z (t) reaches a A _7 -ncighbourhood of irii in at most logarithmic time C(lnA). Since the periods between 
the big jumps are essentially longer, i.e. 

VT X = E(r A - rti) = f A" 9 / 2 » 0(ln A), (3.9) 

we can show that with probability close to 1, the random trajectory Z x is located in a small neighbourhood 
of rrii before the big jump. 

Thus we can summarise the pathwisc behaviour of Zq z for large values of A as follows: 

zlM = z e + A" 7 , si - A" 7 ), 

z$M) « rm + n W \,g e (st-! + \-\ St - A- 7 ) 

(A + rfY 



^(^' +1 -)«™„ 



(3.10) 



whereas on the intervals [t^_ 1 ,t^) the process Z x follows the deterministic trajectory X°. Thus, since we 
know the initial location of the particle, as well as the jump sizes W£ and jump times t£, we can catch the 
essential features of the random path Z x . 

Of course, we have to be carefull when dealing with trajectories which occasionally enter the A~ 7 - 
ncighbour hoods of the saddle points Sj, where the force field U' becomes insignificant. In these neigh- 
bourhoods, the Levy particle has no strong deterministic drift which brings it to a certain well's minimum. 
Thus we cannot decide whether Z x converges to m, or to m,+i. However, in the limit A — > 00, the probability 
that Z x jumps from a neighbourhood of rrii to a A~ 7 -neighbourhood of some Sj is negligible. In our further 
exposition, we do not consider the unstable dynamics in these A '-neighbourhoods and assume that (|3.10p 
holds for all z 6 0;. Interested readers can find rigorous arguments in |Pav06| . 

4 Transitions between the wells in the slow cooling regime 

In this section we justify the limits (|2.17p and (|2.18[) from Theorem 12.31 

First, we obtain the mean value of the first exit time a l ' X form the well f2* in the limit A — > 00. Indeed, 
Z x can roughly leave Hi only at one of the time instants when rrii + W£/(\ + t£) s ^ fij. We can therefore 



G 



calculate the mean value of a l,x using the full probability formula: 

oo 

E y^^E[r^lK A =r t A }] 

oc 



k=l 



k=l 



G Oj, . . . , rrii 



G Q i ,m l 



x\e 



(4.1) 



Since the arrival times t£, t% , ■ • • , r^, are dependent, no straightforward calculation of the expectations in 
the latter sum seems possible. However, we can estimate these expectations from above and below. Our 
argument is based on the inequalities < r A < < ■ ■ ■ < t£ , and the obvious inclusions 



W i \ f 



1 f 

-Gfij C m, 



(A + rfY 



(X + rW 



G 0, > , 1 < J < fc - 1, (4.2) 



where the probability of these events can be calculated explicitly from ()3.6p . to yield the formula 



P m, t + 



(x+ty 



dy 



{Si - mi )(\+t)<> I \y\ 1+a Mx + ty 



(4.3) 



4.1 Mean transition time 

Let us obtain an estimate from above. Note that for each k > 1, the arrival time is a sum of fc independent 
exponentially distributed random variables T x and thus has a Gamma(fc, j3\) distribution with a probability 
density f3\e~ /3xt (f3\t) k ~ 1 /(k — 1)!, t > 0. Then, applying the second inclusion in (|4.2j) we obtain 



E 



< E 



(X + rt) e 

rX 



j, . . . , ui l 



G fii, mi 



(A + ^) 



r fc •I{m l + 1 — i — j-^ G O,, ...,rrii+ 7^— — — G \li,rrn 



(x + r x y 



Pxte 

1 

Pxte-^ 
Summation over k yields 



k 

k~l 



(x + r x y 



(ft -1)1 
03a*)*- 1 r 

(ft-1)! 



P I m t + — ~~TTa G ft, 



(A + t)« 



a- 

fe-i 



P m 



(x + r x y 



a} 



{x + ty 



(^ttAdt 



Px(\ + ty e 



k-l 



Mx + ty 



rdt. 



(4.4) 



Eo,^ A < / /3 A te 



-0xt Qi 



(A + t) c 



■ exp 



fc-i 



/3a(A + ^ 



fc-i 



(A + *)< 



(4.5) 



where denotes an inequality up to negligible error terms. Since a6 < 1, the latter integral converges 
for all A > 0, and it is possible to evaluate it in the limit A — > +00. Introducing a new variable u = ^r-^, 
we transform it to a Laplace type integral with big parameter, which can be evaluated asymptotically (see 
[Qlv74[ Chapter 3]), i.e. 



En.,(r'' A < X 2 



■ exp 



A 2 " ae / g<(« - l)cxp - l)A 1_ae ) 



(4.6) 



1% A 
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Applying analogously the first inclusion from (|4.2|) to the first k — 1 jumps, we obtain the estimate from 
below: 



OO 

>£ 

k=l 

c OO 



k=l 

t(3 x e 
Qit 



(* -1)1 



A 9 

1 - 



A 9 



/3aA« 6 



fc-i 



/3A(A + t)« e 



€ 0,4 , mi 



dt 



(A 



(4.7) 



o (A + i)« ( 



exp 



gig 
A« e 



= A- 



2 - a e f°° Qi(v>- !) 



exp(-q,( u -l)A 1 - Qe ) 



A 



2-afl 



3i (u - 1) exp (- qi (u - l)A 1 "" e ) du = q^X* 6 



Surprisingly, the estimates from below and above coincide, and thus give the asymptotic value of the mean 
life time of the slowly cooled Levy particle in a potential well. 

To obtain the limit (|2.18j) for the mean transition time t i,a between the sets Bi and Uj^aBj, we note 
that at the exit time <r l ' A the process Z x enters some of the wells ilj, j ^ i, with high probability follows the 
deterministic trajectory, and reaches a A-neighbourhood of a well's minimum in a time of the order C(ln A), 
which is negligible in comparison with X a6 . Thus the limit (|2.18|) holds. 

4.2 Transition probability 

To calculate the transition probability between the wells, it suffices to obtain an estimate from below. 
Similarly to the estimate of the mean exit time, we have 



fe=i 



ifixt) 



k=l 
k-1 



X" 



q%j 



(k-iy. 
cxp {-w 



l 



/3a A Q 
dt = X 1 -" 



k-1 



9ij 



Px(\ + t)<* e 



Vij 



X 6 
dt 



e Qi,rrii 



(A + T^* 



(4.8) 



^exp(-< Zi («-l)A 1 - Qe ) 



A 



l-afi 



qij exp {-q t {u - 1)A 1 aB ) du = q^q 



With help of the equality Y^j^ilijli 1 = 1, we conclude that Po, z (Z x (a l ' X ) € ST,) — > ^(jj 1 . Finally, since 
after entering f2j, the process Z A reaches Bj with high probability, Po. 2 (Z A (<7 l,A ) S Qj) w Po, 2 (^ a (t 1,a ) G 
and (j2~T7| holds. 



5 Convergence in the slow cooling regime 

Figure [T] illustrates the typical behaviour of Z in the slow cooling regime, a9 < 1. Roughly speaking, we can 
distinguish two different behaviours: chaotic and regular. 

1. In general case, the initial temperature X~ 9 can be high, so that asymptotics of Theorem 1 2 . 31 does not 
hold. Thus, the transitions of Z A are chaotic until some time instance T, when the temperature (A + T)~ 
becomes low enough, Theorem 12 .31 starts working. Moreover, choosing the time T sufficiently large, we make 
the transition probabilities of Z between the neighbourhoods Bi close to q% 3 jqi with any prescribed precision. 
For brevity, we can also assume that Zq Z (T) £ Bi for some i. 

2. Denote r(k), k > 0, successive transition times after T between different Bj, 1 < j < n, with r(0) = T 
by convention. The mean values Eo iZ r(fc) are finite and can be calculated from Theorem 12.31 Indeed, if 
r(k — 1) = tk-i and Z x (r(k — 1)) = Zk-i £ Bi, then the conditional expectation of Eo j2 t(£;) equals 

E 0) * [r(k)\T(k - 1) = t k -u Z X {r(k - 1)) = z k -i e B t ] = t k -i + E^^r^ 
= t fe _ 1 +E , 2fc _ 1 ^ A+tfc - 1 «t fc _ 1+g ri(A + t fe _ 1 ) Qe <oo. 



8 



4 - 



2 





n 














,1 


1. 




1 T 












200000 
^ 1 ■ 




40 


)00 


600000 


80000 


1-10 6 



Figure 1: A slow cooling of a Levy particle in a potential with local minima at —4, and 3. 

From the time instance T on, Z x makes transitions between the wells with probabilities close to pij = qij/qt, 
i Jt where pa = by convention. The probabilities determine a discrete time Markov chain V{k) 
on {mi, . . . , m n }, such that P(V(fc) = m,j\V(k — 1) = m,) = p^. It is clear, that V has the unique 
invariant distribution tt. Moreover, V{k) converges to the invariant distribution geometrically fast, i.e. there 
is < p < 1 such that for all 1 < i,j < n and k > 

\V mi {V{k)=m j )--K j \ = 0{p k ). (5.2) 

With help of the asymptotic relation 

P(zT A (r(fc) e Bj)\Z x (r(k - 1) E B,)) « py = P(V(fc) = m^fe - 1) = m,). (5.3) 
one can show that the distributions of Z{r(k)) and V(k) are also close for k > 1, i.e. 

P(Z x z (r(k)) G i?,|2T A 2 (T) e B,) « P mj (V(fc) = m,). (5.4) 
Hence, with help of (|5.2p for any prescribed accuracy level we can find fco > 1 such that for k > ko we have 

PoAZ X (r(k)) e Bj) « 7Tj (5.5) 

independently on the initial point z. 

Finally, we note that after time T, the process Z x spends most of the time in the neighbourhoods Bi 1 
and 

ZoJt) ~ Z lMk)), for t e [r(fc),r(fc + 1)). (5.6) 

and thus if t > r(fc ) then P , z (zT A (i) G B,) w tt° . 

As we see, if a.0 < 1, the process Z A reminds of a peace- wise constant jump process on the state space 
{mi, . . . ,m n }. It never stops jumping between the wells of U, and the random sequence Z x (r(k)), k > fco, 
behave as a stationary discrete time Markov chain with a distribution ir. 



6 Trapping in the fast cooling regime 

The regime of fast cooling 8 > 1/a is more simple. We estimate the probability of the exit from a well. Since 
the exit occurs with high probability only at the arrival times of the big jump process ry A , we estimate 

oo 

P , 2 (^ A <«))«^Po, 2 (^ A =T A ) 
fc=l 

■A ( w, x wt 1 wt \ 

< VP (m- + W * n- V r /fce"** * T @t£±dt 

' ' (A + r A )« * 2 *J - y ^ /3a (A + ^ (* - 1)! 



fe=i 



o (A + t) a « ad - 1 A c 



(6.1) 
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Figure 2: A fast cooling of a Levy particle in a potential with local minima at —4, and 3. 



As a consequence we have infinite mean exit times Eo In other words, if 9 > 1/a, the dynamics 

of Z x has two qualitatively different regimes. First, for high temperatures, the transitions between the wells 
are chaotic. Second, when the temperature is low enough, the particle gets trapped in one of the wells, see 
Figure^ In this case, there is no convergence to the invariant measure w. 

7 Conclusion and discussion 

In this paper we studied the large time dynamics of a Levy particle in a multi-well external potential, with 
the temperature decreasing with time as 1/t . 

We discovered, that if the cooling is slow, i.e. 9 < 1/a, then the system reaches a quasi-stationary 
regime where the transition probabilities between the wells converge to certain values which are explicitly 
determined in terms of the potential's spatial geometry. Moreover, the mean transition times arc finite, and 
between the transitions the process lives in a small neighbourhoods of wells' minima. As opposed to the 
Gaussian simulated annealing, the Levy flights process does not settle down near the global maximum of 
U. However, our results can be applied for a search for the global minimum of the potentials, which possess 
the so-called "large-rims-have-deep- wells" property, see [£ch97, Loc02]. i.e. when the spatially largest well is 
at the same time the deepest. Then, having empirical estimates of the local minima locations m, and the 
invariant distribution n, we can derive the coordinates of the saddle points s,, and thus reconstruct the sizes 
of the wells. 

On the other hand, if the cooling is fast, i.e. 9 > 1/a, the Levy particle gets trapped in one of the wells 
when the temperature decreases below some critical level. 

In this paper we do not answer the most interesting question: is it possible to detect a global minimum 
of U with help of a non-local search and Levy flights? The answer to this question is affirmative, and the 
results will be presented in our forthcoming paper. 
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